Extreme fluctuations in noisy task-completion landscapes on scale-free networks 
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C^") . We study the statistics and scaling of extreme fluctuations in noisy task-completion land- 

scapes, such as those emerging in synchronized distributed-computing networks, or generic causally- 
constrained queuing networks, with scale-free topology. In these networks the average size of the 
fluctuations becomes finite (synchronized state) and the extreme fluctuations typically diverge only 
logarithmically in the large system-size limit ensuring synchronization in a practical sense. Provided 
that local fluctuations in the network are short-tailed, the statistics of the extremes are governed 
by the Gumbel distribution. We present large-scale simulation results using the exact algorithmic 
rules, supported by mean-field arguments based on a coarse-grained description. 



PACS numbers: 89.75.Hc, 05.40.-a, 89.20.Ff, 02.70.-c, 68.35.Cf 



The understanding of the characteristics of fluctuations in task-completion landscapes in distributed 
processing networks is important from both fundamental and system-design viewpoints. Here, we 
study the statistics and scaling of the extreme fluctuations in synchronization landscapes of task- 
completion networks with scale-free topology. These systems have a large number of coupled compo- 
nents and the tasks performed on each component (node) evolve according to the local synchronization 
scheme. We consider short-tailed local stochastic task-increments, motivated by certain distributed- 
computing algorithms implemented on networks. In essence, in order to perform certain tasks, pro- 
H ' cessing nodes in the network must often wait for others, since their assigned task may need the output 
of other nodes. Typically, large fluctuations in these networks are to be avoided for performance 
reasons. Understanding the statistics of the extreme fluctuations in our model, will help us to better 
understand the generic features of back-log formations and worst-case delays in networked processing 
systems. We find that the average size of the fluctuations in the associated landscape on scale-free 
networks becomes finite and largest fluctuations diverge only logarithmically in the large system-size 
limit. This weak divergence ensures an autonomously-synchronized, near-uniform progress in the dis- 
tributed processing network. The statistics of the maximum fluctuations on the landscape is governed 
C3 by the Gumbel distribution. 



■ 

C3 ! I. INTRODUCTION 

O ■ 

Many artificial and natural systems can be described by models of complex networks 0, [H, 0, 0, Q ■ The ubiquity 
of complex networks has led to a dramatic increase in the study of the structure of these systems. Recent research 
on networks has shifted the focus from the structural (topological) analysis to the study of processes (dynamics) in 
these complex interconnected systems. The main problem addressed in these studies is how the underlying network 
?3 \ topology influences the collective behavior of the system. 

Synchronization is a good example for processes in networks and it is also a fundamental problem in natural 
and artificial coupled multi-component systems @. Since the introduction of small- world (SW) networks @, Q> it 
has been established that such networks can facilitate autonomous synchronization 0, [ToL |Tl[ . Synchronization in 
the context of coupled nonlinear dynamical systems such as chaotic oscillators has been also studied in scale-free 
networks [H, [H, HH [HI, [H, [13] • In these studies the ratio of the largest and the smallest non-zero eigenvalues of the 
network Laplacian (in the linearized problem) has been used as a measure for "desynchronization" , i.e., smaller ratios 
corresponding to better synchronizability. 

Another synchronization problem emerges in the context of parallel discrete-event simulations [l8L Il9l I20I l2ll. I22I |23| . 
Nodes must frequently "synchronize" with their neighbors (on a given network) to ensure causality in the underlying 
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simulated dynamics. The local synchronizations, however, can introduce correlations in the resulting task-completion 
landscape, leading to strongly non-uniform progress at the individual processing nodes. The above is a prototypical 
example for task- completion landscapes in causally-constrained queuing networks [H| • Analogous questions can also 
be posed in supply-chain networks based on electronic transactions [25j etc. The basic task-completion model has been 
considered for regular (in ID [USE S3 and 2D [H EH), small- world jpl and scale-free (SF) networks [H, S3, HI • 
The extreme fluctuations in SW networks also have been studied [H], 132] previously. Here, we provide a detailed 
account and new results on the extreme fluctuations in task-completion networks with SF structure. Through our 
study, one also gains some insight into the effects of SF interaction topologies on the suppression of critical fluctuations 
in interacting system. 

The field of extremes has attracted the attention of engineers, scientists, mathematicians and statisticians for many 
years. From an engineering point of view, physical structures need to be designed such that special attention is paid 
to properties under extreme conditions requiring an understanding of the statistics of extremes (minima and maxima) 
in addition to average values. [H, [H, 35]. For example, in designing a dam, engineers, in addition to being interested 
in average flood, which gives the total amount of water to be stored, are also interested in the maximum flood, the 
maximum earthquake intensity or the minimum strength of the concrete used in building the dam [36j ] . Extreme- value 
theory is unique as a statistical discipline in that it develops techniques and models for describing the unusual rather 
than the usual [37j . Similarly, in networked processing systems, in addition to the average "load" or progress, knowing 
the typical size and the distribution of the extreme fluctuations is of great importance, since failures and delays are 
triggered by extreme events occurring on an individual node or link. 

The relationship between extremal statistics and universal fluctuations of global order parameters in correlated 
systems has been the subject of recent intense research [H, H EE EE El EE E3, EE EE EE EE EE H3, H3 ■ Closer to 
our interest, universal distributions for explicitly the extreme "height" fluctuations have been studied for fluctuating 
surfaces [53. [Hp. [54l l55l l56l [57j. in particular for the Kardar-Parisi-Zhang (KPZ) surface growth model [58[ in one 
dimension |53l.l54|- It turns out that the basic task-completion landscape (emerging in certain synchronized distributed 
computing schemes), on regular lattices, belongs precisely to the KPZ universality class [13, EH- In this paper, we 
address the suppression of the extreme fluctuations of the local order parameter (local progress) in scale-free (SF) 
noisy task-completion networks. 

This paper is organized as follows. In Section II we give a brief review on the extreme- value statistics of indepen- 
dent and identically-distributed random variables, with some further details for exponential-like random variables. 
Section III describes our prototypical model for task-completion systems and provides a mathematical framework 
to analyze the evolution of its progress landscape. We present our results in Section IV and finish the paper with 
conclusions and summary in Section V. 



II. EXTREME- VALUE STATISTICS 



Extreme- value theory deals with stochastic behavior of the maxima and minima of random variables. Let us first 
focus on independent and identically distributed (iid) random variables. The distributional properties of the extremes 
are determined by the tails of the underlying individual distributions. By definition extreme values are scarce implying 
an extrapolation from observed levels to unobserved levels, and extreme value theory provides a class of models to 
enable such extrapolation J37[. 

Historically, work on extreme value problems may be traced back to as early as 1700s when Bernoulli discussed the 
mean largest distance from the origin given some points lying at random on a straight line of a fixed length (See [34j). 
Theoretical developments of extreme-value statistics in 1920s [33J, l59l . 160 . l6ll . [62j were followed by research dealing 
with practical applications in radioactive emissions [63[ , flood analysis [64j . strength of materials [IE] , seismic analysis 
[66| . rainfall analysis [67} etc. In terms of applications, Gumbel (34|, made several contributions to extreme value 
analysis and called the attention of engineers and statisticians to applications of the extreme-value theory. Here, we 
review 



68] the basics on the statistics of the maximum of N iid random variables. 



Let X be a random variable with probability density function (pdf) f(x) and cumulative distribution function (cdf) 
F(x) (the probability that the individual stochastic variable is less than x). f(x) and F(x) are also referred to as the 
parent distributions. Let {Xi}^L 1 be an iid sample drawn from f(x). Then the joint pdf can be written as 



N 

f(X 1 ,X 2: ...,X N )^l[f(X l ) 

i=l 



(1) 
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and their joint cdf as 

F(X 1 ,X 2 ,...,X N )=l[F(X i ). (2) 

i=i 

Then the cdf of the maximum order statistic, Xm — max{Xi, X 2 , A/v}, for iid random variables, can be written 



as 



F M {x) = Vi{X M < x) 

= Pr(max{Xi,X 2 ,...,Xiv} < x) 

= Pr(Xi < x; X 2 < x; . . . ; X N < x; ) 

N N 
i=l i=l 



(3) 



The pdf of Xm can be calculated by differentiating the equation above with respect to x, yielding 

f M {x)=Nf{x)[F{x)] N - 1 . (4) 

In many situations, extreme value analysis is built on a sequence of data that is block (sample) maxima or minima. 
A traditional discussion on the mean of the sample is based on the central limit theorem and it forms the basis for 
statistical inference theory [69| . The central limit theorem deals with the statistics of the sum Sjy=Xi + X 2 + ... + Xn 
(proportional to the arithmetic average) and provides the constants ajv and &jv>0 such that Yn = (Sn — a-N)/i>N 
tends in distribution to a non-degenerate distribution. In the case when X has finite variance, this distribution is 
the normal distribution. However, when the underlying distribution has a slowly decaying (or heavy) tail, some other 
stable distributions are attained instead of normal distribution [70j . Specifically, power-law distributions with infinite 
variance will yield non-normal limits for the average: the extremes produced by such a sample will "corrupt" the 
average so that an asymptotic behavior different from the normal behavior is obtained [69j . 

As the sample size N goes to infinity, it is clear that for any fixed value of x the distribution of the maxima becomes 

\un o F M (x) = l [ I zpfy- I , (5) 

which is a degenerate distribution (it takes the values and 1 only). If there is a limiting distribution, one has to 
obtain it in terms of a sequence of transformed (or reduced) variable, such as (Xm — aN)/i>N where and &at(> 0) 
may depend on N but not x. The main mathematical challenge here is finding the sequence of numbers (ajv and &jv) 
such that for all real values of x (at which the limit is continuous) the limit goes to a non-degenerate distribution. 

PH Xm ~ aN < x) -> G M (x) asN^oo. (6) 
on 

The problem is twofold: (i) finding all possible (non-degenerate) distributions G that can appear as a limit in 
Eq. ((6]); (ii) characterizing the distributions F for which there exist sequences {a/v} and {6/v} such that Eq. ((6|) holds 
for any such specific limit distribution (69j . The first problem is the (extremal) limit problem and has been solved 
in [331 l62l r7l| and later revived in [72j]. The second part of the problem is called the domain of attraction problem. 
Under the transformation through a^r and bn the extreme types theorem states that the non-degenerate distribution 
Gm belongs to one of the following families 

G M (x) = { exp[-exp(^ £ )], -00 < x < 00 , (7) 



r 1 \ - / °' \f x < X 

^m(x) - I exp[ _ ( _^_)^ otherwise ' (ti) 



Collectively, these three classes of distributions are widely known as Gumbel, Frechet and Weibull distributions, 
respectively. Each family has a location and a scale parameter, A and <r, respectively; additionally, the Frechet and 
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TABLE I: Domain of attractions of the most common distributions for the maximum of iid random variables. 



Distribution Domain 
Normal Gumbel 
Exponential Gumbel 
Lognormal Gumbel 
Gamma Gumbel 
Uniform Weibull 
Pareto Frechet 



Weibull families have a shape parameter uj. The above theorem implies that when Xm can be stabilized with suitable 
sequences ajv and 6jv, the corresponding normalized variable X^^^m—o-n) /on has a limiting distribution that 
must be one of the three types of extreme value distribution. The remarkable feature of this result is that the three 
types of extreme- value distributions are the only possible limits for the distributions of the Xj^, regardless of the 
parent distribution F for the population. In this sense, the theorem is an extreme-value analog of the central limit 
theorem (37| . 

Now we briefly summarize, the basic properties for the maximal values of N independent stochastic variables 
[33L l34l l35l |49L l73j drawn from a generic exponential-like individual pdf. We consider the case when the parent 
complementary cdf (survival function), S(x)=l—F(x), (the probability that the individual stochastic variable is 
larger than x) decays faster than any power law in the tail, i.e., exhibits an exponential-like tail in the large- a; limit. 
(Note that in this case the corresponding probability density function displays the same exponential-like asymptotic 
tail behavior.) Using Eq. the cumulative distribution FmJx) for the largest of the N events (the probability that 
the maximum value is less than x) can be approximated as [43 . [toL [73j 

F M {x) = [F(x)] N = [1 - S(x)] N = e "Mi-S{*)] ~ e- NS ^ , (10) 

where one typically assumes that the dominant contribution to the statistics of the maximum comes from the tail of 
the individual distribution. Now we assume S(x) ~ e~ cx for large x values, where c is a constant and S characterizes 
the exponential-like tail. This yields 

(ii) 

The extreme- value limit theorem implies that there exists a sequence of scaled variables x = (x — ajv)/frjv, such 
that in the limit of iV— >oo, the extreme-value probability distribution for x asymptotically approaches the standard 
form of the Gumbel (also known as Fisher-Tippet Type I) distribution [33J, [3J] : 

G M (x) ~ e~ e ~* , (12) 

with the corresponding pdf 

g M (x) ~ e- J - e "" , (13) 

with mean (x)—j (7=0.577... being the Euler constant) and variance cr| = (i 2 ) — (x) 2 =7r 2 /6. From Eqs. Jll]) 
and (fl~2|) . one can deduce [7|[ that to leading order, the scaling coefficients must be ajv=[ln(JV)/c] 1 / i and 
&AT = (<5c)~ 1 [ln(7V)/c]( 1 /' S " )_1 . Note that for 5=/=l, while the convergence to Eq. ([IT]) is fast, the convergence for the 
appropriately scaled variable to the universal Gumbel distribution in Eq. (|12p is extremely slow (33l . [73j j . The average 
value of the largest of the N iid variables with an exponential-like tails then scales as 

(z max ) = a N + b Nl ~ MN)/c] 1 ' 5 (14) 

(up to 0( w]yT ) corrections) in the asymptotic large- N limit. When comparing with experimental or simulation data, 

instead of Eq. (|12p . it is often convenient to use the Gumbel distribution scaled to zero mean and unit variance, 
yielding 



(15) 
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where a=7r/v6 and 7 is the Euler constant. In particular, the corresponding Gumbel pdf becomes 

g M {y)=ae-^y+-^ {ay+l) . (16) 

The mathematical arguments in obtaining the limit distributions above assume an underlying process consisting of 
a sequence of independent and identically distributed random variables. The most natural application of a sequence 
of independent random variables is to a stationary series. For some physical processes, stationarity is a reasonable 
assumption and corresponds to a series whose variables may be mutually dependent but whose stochastic properties 
are homogeneous in time. There, the main problem is finding the form of stationarity in terms of the range of 
dependence. Then one attempts to find the timescale of the series in which extreme events are almost independent. 
This is a strong assumption, but there are a number of empirical stationary series satisfying this property [7J]. Then, 
eliminating the long-range dependence of extremes provides an opportunity to consider only the effect of short-range 
(or weak) dependence by using some rigorous (35l . |75j or heuristic arguments leading to simple quantification in terms 
of the standard extreme-value limits. 

In this paper we will not discuss in detail the basic formulation and treatment of the extreme limit distributions 
of dependent random variables. Detailed work on limit distributions and conditions required for different kinds of 
sequences such as Markov, m-dependent, moving average, normal sequences etc. can be found in the literature (36l.[3^|. 
Most of the research focused on weakly correlated random variables [HI, [75| and only recent results have become 
available on the statistical properties of the extremes of strongly correlated variables [52], l53l l54l HH, l56l . |57| . Traditional 
approaches, based on effectively uncorrelated variables, immediately break down. Only recently, Majumdar and 
Comtet [53l |54| obtained analytic results for the distribution of extreme-height fluctuations in the simplest strongly 
correlated fluctuating landscape: the steady state of the one dimensional surface-growth EW/KPZ model. 

As it becomes apparent, in light of recent results on SW [32T (76| and our new results on SF networks presented 
here (Sec. IV), implementing our stochastic nonlinear rules for the task-completion model on a complex interaction 
topology, in effect, "eliminates" the complexity of the task-completion landscape. While in low dimensions and regular 
topologies fluctuations are strongly correlated and "critical", in that they are controlled by a diverging correlation 
length, on complex networks, correlations become weak (or mean-field like) , and one expects the extreme fluctuations 
in the task-completion landscape to be effectively governed by the traditional extreme-value limit distributions for 
independent variables. 

III. TASK-COMPLETION NETWORKS 

A. The Model and Its Coarse-grained Description 

Consider an arbitrary network in which the nodes interact through the links. The nodes are assumed to be task 
processing units, such as computers or manufacturing devices. Each node has completed an amount of tasks Ti and 
these together (at all nodes) constitute the task- completion landscape {Ti(t)}fL 1 . Here t is the discrete number of 
parallel steps executed by all nodes, which is proportional to the real time and N is the number of nodes. At each 
parallel step t, only certain nodes can receive additional tasks and when that happens we say that an update happened 
at those nodes. In this particular model the nodes that are allowed to update at a given step are those whose completed 
task amount is not greater than the tasks at their neighbors. We also choose the amount of new tasks arriving at 
a node to be a random variable distributed according to an exponential distribution (Poisson asynchrony). An 
example of a system being described by this model is a parallel computer simulating short-range correlated discrete 
events in continuous time with a Poisson inter-arrival time distribution between the events (independent events) 
[l8l [T9L I20I l2~ll I22I [23j . Thus, denoting the neighborhood of the node i by Si, if Tj(t) < min^s^r^t)}, the node i 
completes some additional exponentially distributed random amount of task. Otherwise, it idles. In its simplest form 
the evolution equation for the amount of task completed at the node i can be written 

7i(i+l)=7i(i) +»*(«) J] 9(^(0 -Ti(i)) , (17) 

where tj is the local field variable (amount of task completed) at node i at time t, r/i(t) are identical, exponentially 
distributed random variables with unit mean, delta-correlated in space and time (the new task amount), and ©(••■) is 
the Heaviside step-function. Despite its simplicity, this rule preserves unaltered the asynchronous causal dynamics of 
the underlying task-completion system [ll| . 

While the dynamics above Eq. (I17p is motivated by the precise algorithmic rule in parallel discrete-event simulations 
(PDES) [H, EiJ Hl|] > it also has broader applications in "causally-connected" stochastic multi-component systems [jj : 
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The "nei ghbo rhood" local minima rule [Eq. (|17[)] is an essential ingredient of generic causally- constrained queuing 
networks [221 ] - In order to perform certain tasks, processing nodes in the queuing/processing network often must 
wait for others, since their assigned task may need the output of other nodes. Exam ples include manufacturing 
supply chains and various e-commerce based services facilitated by interconnected servers |25l . \7l\ . Understanding the 
statistics of the extreme fluctuations in our model, will help us to better understand the generic features of back-log 
formations and worst-case delays in networked processing systems. 

While the local synchronization rule gives rise to strongly non-linear effective interactions between the nodes, we 
can gain some i nsig ht by considering a linearized version of the corresponding coarse-grained equations. As we have 
shown [l9|, Hi], |2Sj . neglecting non-linear effects, the dynamics of the exact model in Eq. (fP7)) can be effectively 
captured by the Edwards- Wilkinson (EW) process [78[ on the respective network. The EW process on the network 
is a prototypical synchronization problem in a noisy environment, where interaction between the nodes is facilitated 
by simple relaxation [ijj [2l|, [7^, H3] through the links: 

N 

dm = - ^ c a (n - t j) + m(t) ■ (18) 
3=1 

Here, (r]i{t)r]j (t'))=25ijS(t — t') and Cij is the coupling matrix with Cu—0. In this work, for simplicity, we only 
consider the case of symmetric couplings, Cij—Cji. By using Cy we can define the network Laplacian, 



where Ci=J2i and rewrite Eq. (fl"8|) as 



Fy — SijCi — Cij , (19) 



N 

d t T i = -J2 T ij T 3+ r li(t) ■ (20) 
3=1 



The above mapping suggests that on low-dimensional regular lattices task-completion landscapes will exhibit kinetic 
rou ghe ning (8ll . [821 183| . The landscape width provides a sensitive measure for the average degree of de-synchronization 

mm- 



■■ 2 (A^)) = (lf>(i)-f(i)] 2 \ , (21) 



i=l 



where (...) denotes an ensemble average over the noise and f (t)=(l/JV) Ei=i n(t) is the mean value of the local task 
at time t. In addition to the width, we will study the scaling behavior of the average of the largest fluctuations above 
the mean in the steady-state regime 

(A max ) = (r max (f) - f(t)} , (22) 

where T raax (i) = max{ri(f ),r 2 (i), ...,r N (t)}. 

Since we use the formalism and terminology of non-equilibrium surface growth phenomena, we briefly review scaling 
concepts for self-affine or rough surfaces, on regular spatial lattices. The scaling behavior of the width, (w 2 (N,t)), 
alone typically captures and identifies the universality class of the non-equilibrium growth process (8ll . |82| . [83| . In a 
finite system the width initially grows as (w 2 (N, i))~i 2/3 , and after a system-size dependent cross-over time t x ~N z , it 
reaches a steady-state value (w 2 (iV, i))~iV 2a for t~^>t x . In the relations above a, (3, and z—^ are called the roughness, 
the growth, and the dynamic exponent, respectively. In this work, we will only consider the steady-state properties 
of the associated task-completion landscapes. 



84] 
58] 



B. Previous Work: Extreme-Fluctuations in Regular and SW Networks 

In one dimension on a regular lattice, with the relevant non-linearities taken into account, we have shown [lii , 
that the evolution of the task-completion landscape Eq. (JT7J) belongs to the the Kardar-Parisi-Zhang (KPZ) 
universality class [8l|. Indeed, when simulating the precise rule given by Eq. (JT7J) , the evolution of the associated 
task-completion landscape exhibits KPZ-like kinetic roughening [L9L [281] . Further, in the steady-state, fluctuations 
are governed by the Edwards- Wilkinson Hamiltonian [851 ] . 

In regular networks, the task-completion landscape is rough [H, H^] (de-synchronized state), i.e., it is dominated by 
large-amplitude long-wavelength fluctuations. The extreme local fluctuations emerge through these long-wavelength 
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(a) Width distribution (b) Maximum fluctuations distribution 



FIG. 1: (a) The scaled distribution of the width of task-completion landscapes on a one-dimensional regular network. The 
inset is the same graph in log-linear scale. The dashed curve is the scaled width distribution of KPZ/EW surface [8(|. (b) The 
scaled distribution of the maximum fluctuations in the same network. The inset is in log-linear scale and the dashed curve is 
the appropriately scaled Airy distribution function [531. |54||. 



modes and, in one-dimensional regular networks, the extreme and average fluctuations follow the same power-law 
divergence with the system size [H El IH III Is! lEz| 

(A max ) ~ ~ N a ~ N 1 ' 2 , (23) 

where a=l/2 is the roughness exponent for the KPZ/EW surfaces [8l|. On this regular lattice, the average size of the 
largest fluctuations below the mean ((A m j n ) = (f — r m i n )) and the maximum spread ((A max _ m i n ) = (r max — r m i n )) 
follow the same scaling as the average maximum fluctuation with the system size. The diverging width is related to an 
underlying diverging length scale, the lateral correlation length, which reaches the system size N for a finite system. 
This divergent width hinders the synchronization (near-uniform progress) in low-dimensional regular task-completion 
networks (Mill- 

The width distribution for the EW (or a steady-state one-dimensional KPZ) class is characterized by a universal 
scaling function, $(x), such that P{w 2 ) = (w 2 )~ 1 ^(w 2 / (w 2 )) = N^ 1 ^(w 2 /N), where &(x) can be obtained analyti- 
cally for a number of models including the EW class [86| . The width distribution for the task-completion system on a 
one-dimensional network is shown in Fig.QJa). Systems with N > 10 3 show convincing data collapse onto this exact 
scaling function. The convergence to the limit distribution is very slow when compared to other microscopic models, 
such as the single-step model [HH3], belonging to the same KPZ universality class. 

The extreme- value limit theorems summarized in the previous section are valid only for independent (or short-range 
correlated) random variables. Since the "heights" (local progress) in task-completion landscapes of regular networks 
are strongly correlated, the known extreme- value limit theorems cannot be used. Some remarkable recent analytic work 
yielded the distribution of the extreme heights for the one-dimensional EW/KPZ steady-state surface p53l. 154, l55l |5(| . 
Although the local microscopic rule for the evolution of the task-completion landscapes are different, they belong 
to the same EW/KPZ universality class in one dimension [8l|, and hence, expected to exhibit the same universal 
distribution for the extreme fluctuations. Equation (|23[) suggests that, similar to the width and its distribution, 
there is a single scale governing the diverging extremes fluctuations, and hence, the normalized probability density 
function of the maximum relative fluctuations A max has a universal scaling form, P(A max ) ~ N~ a f(A max /N a ). For 
the ID EW/KPZ surface with periodic boundary conditions (a— 1/2), by using path integral techniques, Majumdar 
and Comtet [H,[54| found f(x) to be the so-called Airy distribution function. Our simulation results show that the 
appropriately scaled maximum relative height distributions are in agreement with the theoretical distribution as can 
be seen in Fig. [2(b). 

Recently, we have studied the extreme fluctuations in task-completion landscapes on SW networks [32l . [76j . fn 
particular, we considered two SW-synchronized network models: in one case a small (variable) density of random 
links were added on top of a one-dimensional ring; in the other case, each node had exactly one random (possibly 
long-range) connection, and the "coupling strength" (relative frequency of synchronization through the long-range 
link) was varied. The basic findings were the same for both cases. As a result of the non-zero density or non-zero 
strength of random links, the correlation length £ becomes finite in such networks (as opposed to the diverging 
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correlation length on the one-dimensional ring.) This important property is intimately related to the emergence 
of an effective non-zero mass of the corresponding network propagator (the inverse of the network Laplacian) [7^ |. 
This is the fundamental effect of extending the original dynamics to a SW network: it decouples the fluctuations 
of the originally correlated landscape. Then, the extreme-value limit theorems can be applied using the number of 
independent blocks N/£ in the system [49], [73[. For short tailed noise, the local individual task fluctuations also 
exhibit short (exponential-like) tails, S(A,) ~ exp[— c(Ai/w) s ], where Ai—ri—f is the relative "height" measured 
from the mean at site i. (Note that the exponent S for the tail of the local relative height distribution may differ from 
that of the noise as a result of the collective (possibly non-linear) dynamics, but the exponential-like feature does not 
change.) Then the (appropriately scaled) largest fluctuations are governed by the Gumbel pdf [Eq. {12])], and the 
average maximum relative height scales as 



, f\n{N/0\ 1/S w n 



(Note, that both w and £ approach their finite asymptotic jV-independent values for SW-coupled systems, and the only 
iV-dependent factor is ln(iV) for large N values.) In SW synchronized systems with unbounded local variables driven 
by exponential- like noise distribution (such as Gaussian), the extremal fluctuations increase only logarithmically with 
the number of nodes. This weak divergence, which one can regard as marginal, ensures synchronization for practical 
purposes in coupled multi-component systems. 

Note that the exact "microscopic" dynamics [Eq. (jTTJ)] based on the task-completion rule, is inherently non-linear, 



but the effects of the non-linearities only give rise to a renormalized non-zero effective mass |21[. Thus, the syn- 
chronization dynamics is effectively governed by EW relaxation in a SW, yielding a finite correlation length and, 
consequently, the slow logarithmic increase of the extreme fluctuations with the system size [Eq. (|24p]. Also, for 
the task-completion landscapes, the local height distribution can be asymmetric with respect to the mean, but the 
average size of the height fluctuations is, of course, finite for both above and below the mean. This specific character- 
istic simply yields different prefactors for the extreme fluctuations [Eq. ([24])] above and below the mean, leaving the 
logarithmic scaling with N unchanged. 

Simulating the exact local task-completion rule Eq. (|T7]) . we observed, that the local height fluctuations exhibit 
simple exponential tails, hence S = 1 and the extremes scale as In (TV) with the number of nodes [U HU, [7g]. The 
largest relative deviations below the mean (A min ), and the maximum spread (A max ^ min ) follows the same logarithmic 
scaling with the system size N. 



IV. SCALE-FREE TASK-COMPLETION NETWORKS 



Recent studies show that many natural and artificial systems such as the Internet, World Wide Web, scientific 
collaboration networks, and e-mail networks have power-law degree (connectivity) distributions [![, i.e., the probability 
of having nodes with k degrees is P(k) ~ fc~ 7 where 7 is usually between 2 and 3. These systems are commonly 
known as power-law or scale-free networks since their degree distributions arc free of scale and follow power-law 
distributions over many orders of magnitude. Scale- free networks have many interesting properties such as high 
tolerance to random errors and attacks (yet low tolerance to attacks targeted at hubs) [88J], high synchronizability 
[24l [29l [3f3 | , and resistance to congestion [89T |9C| . 

In this paper, in part, we employed the Barabdsi- Albert (BA) model of network growth inspired by the formation 
of World Wide Web [9l| to generate scale-free networks. This model is based on two basic observations: growth and 
preferential attachment. The basic idea is that the high-degree nodes attract links faster than low-degree nodes. The 
network starts growing from mo=m + 1 nodes and at every time step a new node with m ("stubs") possible links 
is added to the network. The probability that the new node j is connected to already existing node i is linearly 
proportional to the degree of the node j, i.e., Pr(j — > j)=kj/^2n ki- Once the given number of nodes N is reached in 
the network, the process is stopped. For the BA network, the degree distribution is a power law in the asymptotic 
system size limit (JV— >oo, also called thermodynamic limit), PsA{k) ~ 2m 2 //c 3 .(In obtaining this normalization, one 
replaces the sum by the integral over the degree.) Since every node has m links initially, the network at time t will 
have N=mo + t nodes and E=mt links, thus the average degree (k)=2m for large enough t. The special case of the 
model when m = 1 creates a network without any loops, i.e., the network becomes a tree with no clustering. 

Another model we employed to generate scale-free networks and to compare with the BA model is the configuration 
model (CM). The CM 0, M, H was introduced as an algorithm to generate random networks with a given degree 
distribution. Although CM has been considered to generate uncorrelated random networks, it was shown that it has 
correlations, especially between the nodes with larger degrees [H, |96|. In CM, the vertices of the graph are assigned 
a sequence of degrees {ki}fL Q , m < ki < k c from a desired distribution P(k). (There is an additional constraint that 
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the J2i ki must be even.) Then, pairs of nodes are chosen randomly and connected by undirected edges. This model 
generates a network with the expected degree distribution and no degree correlations; however, it allows self-loops 
and multiple-connections when it is used as described above. It was proven in Ref. [95| that the number of multiple 
connections when the maximum degree is fixed to the system size, i.e., k c =N ', scales with the system size N as 
iV 3-7 lniV. After this procedure we simply delete the multiple connections and self-loops from the network which 
gives a very marginal error in the degree distribution exponent. This might also cause that some negligible number 
of nodes in the network to have degrees less than the fixed minimum degree (to) value or even zero. One another 
characteristic of the CM is that the network may not be a connected network for small values of to such as 1 and even 
2, i.e., it has disconnected clusters (or components). For high values of to, the network is almost surely connected 
having one giant component including all the nodes. The degree distribution of SF networks with degree exponent 7 
(for k c ^> to) can be written as 

PQc) ^ (7- l)™ 7 - 1 /^ 7 , (25) 

where to is the minimum degree in the network, and again, in obtaining the above normalization, we replaced 
the sum by the integral over the degree. Then the average and the minimum degree are then related through 
(fc)=m(7-l)/(7-2). 



A. Mean-Field and Exact Numerical Diagonalization Approaches for the EW Process on SF Networks 

We, again, can gain some insight to the problem by first considering the linearized effective equations of motion, 
i.e., the EW process [Eq. (|18p] on a SF network. In the mean-field (MF) approximation, local task fluctuations about 
the mean are decoupled and reach a stationary distribution with variance [30( 

<(T,-f) a >« W- (26) 

For identical (unweighted) couplings (with unit link strength without loss of generality), Cy is simply the adjacency 
matrix, hence, C; = J2i Ca = hi, i.e., the degree of node i. Then, for the width, one can write 

2—1 i i 

where using infinity as the upper limit in the above integral is justified for SF networks as N — > 00, since 7 > 0. Using 
the degree distribution of SF networks given by Eq. (|2"5|) , one finally obtains the mean- field expression for the width 

to 7 (k) 7(7 — 2) 

The main message of the above result is that the width approaches a finite value in the limit of N — > 00, and for the 
linearized problem, should scale as (w 2 ) ~ 1/m ~ \/ (k). 

Extracting the steady-state width from exact numerical diagonalization (30l . |80| through 

W-sEs' (29) 

fc=i 

where Xk are the non-zero eigenvalues of the network Laplacian on the corresponding SF network, supports these 
MF predictions [Fig. [2]. Except for the to = 1 BA network (when the network is a scale- free tree), finite-size effects 
are negligible as the width approaches a finite value in the N — > 00 limit [Fig. [21(a)]. For to = 1, the width weakly 
(logarithmically) diverges with the system size [Fig. [21(a) inset]. A closer look at the spectrum reveals that the gap 
approaches a non-zero value for to > 1 as TV — * 00, while it slowly vanishes for the to = 1 BA network. As can be 
expected, Fig. [2](b) (inset) indicates that MF scaling Eq. ([28]) for the width works well for sufficiently large minimum 

(and average) degree, to ~ O(10). Figure [2(c) also shows results for the CM network for two values of 7, and the 
corresponding MF result. 

We also note that the average width, in principle, can also be obtained by employing the density of states (dos) p(X) 
of the underlying network Laplacian through (w 2 ) — (1/A)^^ 1 1/A; ~ f(l/\)p(\)d\, in the asymptotic large- iV 
limit |79 L [97| . Obtaining the dos analytically, however, is a rather challenging task. Just recently, using the replica 
method |98l. [99|. Kim and Kahng obtained the dos for the Laplacian of SF graphs jlOdl ]. which they were able to 
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FIG. 2: Steady-state width of the EW synchronization landscape from exact numerical diagonalization using Eq. (|29[1 . (a) For 
the BA network, as a function of N for various values of the minimum degree m. The inset shows the same data on log-lin 
scales, (b) For the BA network, as a function of m for different system sizes N. The inset shows the behavior of the width vs 
1/m; the solid straight line represents the MF result Eq. (|28[) . (c) For the BA and CM networks (with 7 = 3.0 and 7 = 3.5) as 
a function of l/(fc), where (fc) is the average degree, for two system sizes. The bold straight solid and dashed lines correspond 
to the MF result Eq. ([28} with 7 = 3.0 and 7 = 3.5, respectively. 



evaluate in the asymptotic l<<(fc)<<iV limit. Utilizing their result, we have checked and found full agreement with 
Eq. (J28]) for the width. 

While our MF approach above does not directly address the typical size of the maximum relative height of the 
task-completion landscape, the finding that the width is finite in the N — > 00 limit suggests that correlations between 
height fluctuations at different nodes are weak (with the exception of the to = 1 BA tree). Then, one can argue 
on the scaling of the extremes as follows. The largest fluctuations will most likely emerge from the nodes with (or 
close to) the smallest degree to [Eq. I|26p]. The typical size of the fluctuations on such nodes, according Eq. (|26p . 
is \J JJji — ^) 2 ) fc . =m ~ rnT 1 ! 2 . The expected number of nodes with the smallest degree to is N m ~ NP(m) ~ 
(7 — l)(N/m). Thus, assuming that the fluctuations on these nodes are independent, we expect 

<A max ) = (r max - f> ~ V{(n-f) 2 ) ki=m pn[( 7 - 1) (N/m)]} 1/S ~ m^ 2 [ln(N)] 1/S , (30) 

and the distribution of the extremes is governed by the Gumbel distribution in the asymptotic large- N limit. Note 
that the exponent S depends on the details of the noise (or local stochastic task increments), e.g., S—2 for Gaussian- like 
tails and 6=1 for exponential tails. The to -1 / 2 pre-factor is also specific to the linear EW coupling on the network by 
virtue of Eq. (|26|) , and we do not expect to be generally applicable. We do expect, however, that the weak logarithmic 
divergence with the system size, Eq. (|30j) . governed by the Gumbel distribution, will hold for the actual simulated 
task-completion landscape which evolves according to the synchronization rule Eq. (fTT)) . on SF networks. 



B. Simulation Results 



In this subsection we present detailed results and analysis of the simulations of the exact task-completion rule 
Eq. (fTT]) on BA and CM networks. We simulated the task-completion system on these networks and measured the 
steady-state width Eq. (I21j) and maximum fluctuations over many different network realizations and generated their 
distributions. 

Fig. [3] shows the average maximum fluctuations and the width as function of m for different system sizes ranging 
from 100 to 10,000. Each data point was obtained by averaging over ten different network realizations. As it can 
be seen from Fig. [3]Ja), (A max ) rapidly approaches a system-size-dependent constant. For the m = 1 BA model, the 
network is a tree, and (A max ) is visibly larger than for higher values of m. Figure[3fb) contains the same data points 
as Fig. [3Ja), but the data is plotted as function of the system size, for different values of to. The average maximum 
fluctuations in Fig. [3fb) scale logarithmically (or diverge weakly) with the system size for all values of to. Again, the 
to = 1 case is different from others in terms of the pre-factors, although they all exhibit logarithmic divergence. Thus, 
for BA networks, we find 

(A max ) ~ ln(N) . (31) 

supporting the MF prediction Eq. (|30|) . The "clean" logarithmic scaling in Fig. E^b) is the result of the individual 
task distributions P(ji — f) having an exponential tail (5 = 1) for the task-completion rule. 
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FIG. 3: Average maximum fluctuations and average width for SF networks generated by the BA model. The data points are 
obtained by averaging over ten different network realizations. 



With the exception of the m=l BA tree, the width converges to an essentially system-size-independent, but non- 
zero, value [Fig. Efc)] . The main difference, with respect to the MF prediction, is the non- vanishing "intrinsic" width 
as to — ► co. This behavior is due to the specific synchronization rule Eq. ()17|) . Namely, when m is large, only a couple 
of nodes are allowed to increment, hence the landscape fluctuations are essentially governed by the stochastic task 
increments at these nodes. Since the variance of the local fluctuations is unity, the width of the landscape converges 
to unity for large to [Fig. [3(c)]. It can be seen in Fig. [3(d) that the width has a logarithmic divergence for to = 1 and 
it is a constant for to > 1, i.e., for large N 

(w 2 (N))~{ HN) > ifm = 1 . (32) 
I const., if to > 1 

The CM network has very similar characteristics to the BA model in terms of the scaling of maximum fluctuations 
and width. Fig. H(a) shows that the average maximum fluctuations for CM network with 7 = 3, as a function of to, 
have the same behavior as for the BA model. Since the CM generates a (single-component) connected network with 
very low probability for to = 1, we only present results for to > 1. As it can be seen in Fig. 1Kb), (A max ) increases 
logarithmically with the system size. The data points were obtained by averaging over ten different realizations of the 
network. One observes that at low values of 7, (A max (m = 2)) is closer to (A max (m > 2)) and the difference increases 
as 7 increases. This implies that having fewer high-degree nodes in the network (7 = 4) separates (A max (m = 2)) 
from (A max (TO > 2)). 

The average width as a function of to [Fig. [1(c)] for 7 = 3 decays and reaches its asymptotic value. The scaling of 
the width as a function of the system size is in Fig. [4(d) . The error bars are quite visible although we use at least 
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FIG. 4: Average maximum fluctuations and the width for SF CM networks with 7 = 3 versus system size and m. The data 
points are obtained by averaging over ten different network realizations. 



ten different network realizations. There is a slight increase in the width as a function of the system size for to = 2, 
whereas for larger to, the width quickly saturates as a function of N. 

Fig. Efa) shows the individual task distributions (parent distributions for the extremes) for the BA network with 
to = 2 and N = 10 4 . These distributions exhibit simple exponential tails (6=1) (inherited from the local exponential 
task- increments). The nodes for which the distributions presented in Fig. 02 a ) were selected manually according to 
their degrees. We selected high (also maximum), middle and low (also minimum) degree nodes. The legend shows 
both the index of the node, which is the "age" of the node according to the preferential attachment procedure in 
the BA model, and its degree. For larger to the distributions yield better collapse to an exponential, and also their 
negative parts (for the fluctuations below the mean) become smaller, i.e., the fluctuations are asymmetric about the 
mean (due to the specific local task-increment rules). It can also be seen that the negative part of the individual task 
distributions are not pure exponentials, i.e., 5 > 1, which makes the convergence of the fluctuations of the minima 
(A m i„) toward their limiting Gumbel distribution much slower. 

Figs. 02b) and 02c) show the distributions of the maximum fluctuations and the width for the BA model with 
to = 2 and their comparison to the Gumbel and Gaussian distributions, respectively. The insets in Figs. 02b) and02 c ) 
have the same data as the main graph but scaled to zero mean and unit variance, and in a log-linear scale to show 
the collapse to the limit distributions in the tails. The pure exponential behavior of individual task distributions in 
Fig.02 a ) suggests that the limit distribution for the maximum fluctuations would be a Gumbel distribution. As it can 
be seen in Fig. 02^) the limit distributions have better collapse as the system size gets larger. The width distributions 
for the BA model with m = 2 are plotted in Fig. 02 c ) • The mean-field approximation predicts that the local task 
fluctuations are decoupled and consequently the distribution of the width converges to a Gaussian for large enough 
systems. We verified this prediction and showed that the width distributions converge to delta functions, and when 
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(a) Individual fluctuations distribution (b) Maximum fluctuations distribution (c) Width distribution 



FIG. 5: Distribution of individual fluctuations (a), maximum fluctuations (b) and the width (c) for the BA model with m — 2. 
The different individual fluctuations distributions in (a) are for different degree values ranging from the maximum to the 
minimum. The inset in (b) shows the maximum fluctuations distribution scaled to zero mean and unit variance in a log-linear 
scale. The dashed curves in the insets represent the Gumbel pdf [Eq. (|16|l ] in (b) and Gaussian pdf in (c) scaled in the same 
way. The system size is N = 10 4 . 
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FIG. 6: Same as Fig. [5] for the CM network with 7 = 3 and m — 3. 



(c) Width distribution 



they are scaled to zero mean and unit variance they collapse to a standard Gaussian distribution for large enough 
system size. When m = 1 the width distribution converges to a nontrivial shape with an exponential tail. 

Similar to individual task distributions in the BA model, the CM has pure exponential distributions in the tail as 
shown in Fig. HJa) for m — 3, 7 = 3, and system size N = 10 4 . The nodes are selected according to their degrees, i.e., 
a few high, middle and low-degree nodes. The maximum fluctuation distributions converge to Gumbel distributions 
even for small systems as it can be seen in Fig. UJb). It can be concluded for the CM that the width distributions 
converge to delta functions as system size goes to infinity and when they are scaled to zero mean and unit variance 
they converge to the standard Gaussian [Fig. [Sic)]. For the somewhat subtle case of the CM network with m = 2 the 
convergence to a finite width is slow [see Fig. BJd)] possibly due to strong finite system-size effects. 



V. SUMMARY AND CONCLUSIONS 



In summary, we considered the average and maximum fluctuations above the mean in scale-free task-completion 
landscapes with local relaxation, unbounded local variables, and short-tailed noise. We argued, that when the inter- 
action topology is scale-free, having a power-law degree distribution, the statistics of the extremes is governed by the 
Gumbel distribution while the distribution of average fluctuations converges to a Gaussian when appropriately scaled. 
This finding directly addresses synchronizability in generic task-completion systems with scale-free network topology 
where relaxation through the links is the relevant node-to-node process and effectively governs the dynamics. Analo- 
gous questions for heavy-tailed noise dist ribution on complex networks hay e relevance to various transport phenomena 
in natural, artificial, and social systems [lOll 1 1021 . Il03l llO 4 Il05l Hotl Il07l | . For example, " burs ty" temporal processes 
in queuing networks have been recently attributed to online activities initiated by humans |l08l | . Correspondingly, one 
shall then study extreme fluctuations in task-completion landscapes where the local task increments are power-law 
distributed. Heavy-tailed noise typically generates similarly tailed local field variables through the collective dynamics 
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in SW [3l|, HH and SF networks L 109]. Then, the largest fluctuations will likely diverge as a power law with the system 
size, expectedly governed by the Frechet distribution [oil. |35|]. 



Acknowledgments 

We thank S. Majumdar for providing us with the numerically evaluated Airy distribution [53ll54T|. shown in Fig.QJb) 
for comparison. We also thank Z. Racz for valuable discussions. H.G. was supported by the U.S. DOE through DE- 
AC52-06NA25396. G.K. acknowledges the financial support of NSF through DMR-0426488 and RPI's Seed Grant. 
Z.T. has been supported by the University of Notre Dame. 



[1] S. Boccaletti, V. Latora, Y. Moreno, M. Chavez, and D.-U. Hwang, Phys. Rep. 424, 175 (2006). 

[2] M. Newman, SIAM Review 45, 167 (2003). 

[3] S. Dorogovtsev and J. Mendes, Adv. Phys. 51, 1079 (2002). 

[4] R. Albert and A.-L. Barabasi, Rev. Mod. Phys. 74, 47 (2002). 

[5] B. Bollobas, Random Graphs (Cambridge University Press, Cambridge, UK, 2001). 

[6] S. Strogatz, Nature 410, 268 (2001). 

[7] D. Watts and S. Strogatz, Nature 393, 440 (1998). 

[8] D. Watts, Small Worlds (Princeton Univ. Press, Princeton, 1999). 

[9] M. Barahona and L. Pecora, Phys. Rev. Lett. 89, 054101 (2002). 
[10] X. Wang and G. Chen, Int. J. Bifurcation and Chaos 12, 187 (2002). 
[11] H. Hong, B. Kim, and M. Choi, Phys. Rev. E 66, 018101 (2002). 
[12] X. Wang and G. Chen, IEEE Trans. Circuit Systems I 49, 54 (2002). 

[13] T. Nishikawa, A. Motter, Y.-C. Lai, and F. Hoppensteadt, Phys. Rev. Lett. 91, 014101 (2003). 

[14] A. Motter, C. Zhou, and J. Kurths, Europhys. Lett. 69, 334 (2005). 

[15] A. Motter, C. Zhou, and J. Kurths, Phys. Rev. E. 71, 016116 (2005). 

[16] C. Zhou, A. Motter, and J. Kurths, Phys. Rev. Lett. 96, 034101 (2006). 

[17] C. Zhou and J. Kurths, Chaos 16, 015104 (2006). 

[18] B. Lubachevsky, J. Comput. Phys. 75, 103 (1988). 

[19] G. Korniss, Z. Toroczkai, M. Novotny, and P. Rikvold, Phys. Rev. Lett. 84, 1351 (2000). 
[20] P. Sloot, B. Overeinder, and A. Schoneveld, Comput. Phys. Commun. 142, 76 (2001). 
[21] G. Korniss, M. Novotny, H. Guclu, Z. Toroczkai, and P. Rikvold, Science 299, 677 (2003). 
[22] S. Kirkpatrick, Science 299, 668 (2003). 

[23] A. Kolakowska and M. A. Novotny, in Progress in Computer Science Research (Nova Science Publishers, 2005), p. 151. 
[24] Z. Toroczkai, G. Korniss, M. Novotny, and H. Guclu, Santa Fe Institute Studies in the Sciences of Complexity Series: 

Computational Complexity and Statistical Physics, ed. by A. Percus and G. Istrate and C. Moore (Oxford University 

Press, NY, 2006), chap. 11, p. 249. 
[25] A. Nagurney, J. Cruz, J. Dong, and D. Zhang, European J. of Operational Research 164, 120 (2005). 
[26] G. Korniss, M. Novotny, P. Rikvold, H. Guclu, and Z. Toroczkai, in Materials Research Society Symposium Proceedings 

Series (2001), vol. 700, p. 297. 

[27] G. Korniss, M. Novotny, A. Kolakowska, and H. Guclu, in Proceedings of the 2002 ACM Symposium On Applied Computing 

(SAC 2002) (2002), p. 132. 
[28] H. Guclu, G. Korniss, M. Novotny, Z. Toroczkai, and Z. Racz, Phys. Rev. E 73, 066115 (2006). 
[29] H. Guclu, Ph.D. thesis, Rensselaer Polytechnic Institute (2005), arXiv:cond-mat/0601278. 
[30] G. Korniss, arXiv:cond-mat/0609098 (2006). 

[31] H. Guclu, G. Korniss, Z. Toroczkai, and M. Novotny, in Lecture Notes in Physics: Complex Networks, edited by E. Ben- 

Naim, H. Frauenfelder, and Z. Toroczkai (Springer- Verlag, 2004), vol. 650, p. 255. 
[32] H. Guclu and G. Korniss, Fluctuation and Noise Letters 5, L43 (2005). 
[33] R. Fisher and L. Tippett, Proc. Camb. Philos. Soc. 24, 180 (1928). 
[34] E. Gumbel, Statistics of Extremes (Columbia University Press, New York, 1958). 

[35] J. Galambos, The Asymptotic Theory of Extreme Order Statistics (Krieger Pub Co; 2nd edition, Malabar, Florida, 1987). 
[36] E. Castillo, A. Hadi, N. Balakrishnan, and J. Sarabia, Extreme Value and Related Models With Applications in Engineering 

and Science (Wiley Interscience, New Jersey, 2005). 
[37] S. Coles, An Introduction to Statistical Modeling of Extreme Values (Springer, London, 2001). 
[38] S. Bramwell, P. Holdsworth, and J.-F. Plinton, Nature 396, 552 (1998). 

[39] S. Bramwell, K. Christensen, J.-Y. Fortin, P. C. Holdsworth, H. Jensen, S. Lise, J. Lopez, M. Nicodemi, J.-F. Pinton, 

and M. Sellitto, Phys. Rev. Lett. 84, 3744 (2000). 
[40] N. W. Watkins, S. C. Chapman, and G. Rowlands, Phys. Rev. Lett. 89, 208901 (2002). 



15 



S. Bramwell, K. Christensen, J.-Y. Fortin, P. C. Holdsworth, H. Jensen, S. Lise, J. Lopez, M. Nicodemi, J.-F. Pinton, 
and M. Sellitto, Phys. Rev. Lett. 89, 208902 (2002). 

S. Bramwell, J.-Y. Fortin, P. C. Holdsworth, S. Peysson, J.-F. Pinton, B. Portelli, and M. Sellitto, Phys. Rev. E 63, 
041106 (2001). 

V. Aji and N. Goldenfeld, Phys. Rev. Lett. 86, 1007 (2001). 

T. Antal, M. Droz, G. Gyorgyi, and Z. Racz, Phys. Rev. Lett. 87, 240601 (2001). 
T. Antal, M. Droz, G. Gyorgyi, and Z. Racz, Phys. Rev. E 65, 046140 (2002). 
K. Dahlstedt and H. Jensen, J. Phys. A 34, 11193 (2001). 

S. C. Chapman, G. Rowlands, and N. W. Watkins, Nonlinear Processes in Geophysics 9, 409 (2002). 
G. Gyorgyi, P. Holdsworth, B. Portelli, and Z. Racz, Phys. Rev. E 68, 056116 (2003). 
J.-P. Bouchaud and M. Mezard, J. Phys. A 30, 7997 (1997). 

A. Baldassarri, A. Gabrielli, and B. Sapoval, Europhys. Lett. 59, 232 (2002). 
E. Bertin, Phys. Rev. Lett. 95, 170601 (2005). 

S. Raychaudhuri, M. Cranston, C. Przybyla, and Y. Shapir, Phys. Rev. Lett. 87, 136101 (2001). 

S. Majumdar and A. Comtet, Phys. Rev. Lett. 92, 225501 (2004). 

S. Majumdar and A. Comtet, J. Stat. Phys. 119, 777 (2005). 

M. Kearney and S. Majumdar, J. Phys. A: Math. Gen. 38, 4097 (2005). 

G. Schehr and S. Majumdar, Phys. Rev. E 73, 056103 (2006). 

G. Gyorgyi, N. Moloney, K. Ozogany, and Z. Racz, arXiv: |cond-mat/0610463 (2006). 
M. Kardar, G. Parisi, and Y.-C. Zhang, Phys. Rev. Lett. 56, 889 (1986). 

L. von Bortkiewicz, Berlin Math. Ges. 21, 3 (1922). 

R. von Mises, Berlin Math. Ges. 1, 141 (1923). 

E. Dodd, Trans. Amer. Math. Soc. 25, 525 (1923). 

M. Frechet, Ann. Soc. Polon. Math. Cracovie 6, 93 (1927). 

E. Gumbel, J. Phys. Radium 8, 446 (1937). 

E. Gumbel, Ann. Math. Statis. 12, 163 (1941). 

W. Weibull, Ing. Vet. Akad. Handlingar 153, 2 (1939). 

J. Nordquist, Trans. Amer. Geophys. Union 26, 29 (1945). 

W. Potter, Tech. Rep. 985, U.S. Deparetment of Agriculture (1959). 

S. Kotz and S. Nadarajah, Extreme Value Distributions: Theory and Applications (Imperial College Press, London, 2000). 
J. Beirlant, Y. Goegebeur, J. Segers, and J. Teugels, Statistics of Extremes: Theory and Applications (John Wiley, West 
Sussex, UK, 2004). 

J.-P. Bouchaud, Theory of Financial Risk (Cambridge Univ. Press, Cambridge, 2000). 

B. Gnedenko, Annals of Mathematics 44, 423 (1943). 

L. de Haan, On Regular Variation and its Applications to the Weak Convergence of Sample Extremes (Mathematical 
Centre Tract, 32, Amsterdam, 1970). 

A. Baldassarri, Ph.D. thesis, De l'Universite Paris XI Orsay (2000). 

J. Eichner, J. Kantelhardt, A. Bunde, and S. Havlin, Phys. Rev. E 73, 016130 (2006). 
S. Berman, Ann. Math. Statist. 35, 502 (1964). 

H. Guclu and G. Korniss, Phys. Rev. E 69, 065104(R) (2004). 

D. Zhang, J. Dong, and A. Nagurney, in Innovations in Financial and Economic Networks, edited by A. Nagurney 
(Edward Elgar, 2003). 

S. Edwards and D. Wilkinson, Proc. R. Soc. London, Ser A 381, 17 (1982). 

B. Kozma, M. Hastings, and G. Korniss, Phys. Rev. Lett. 92, 108701 (2004). 

G. Korniss, M. Hastings, K. Bassler, M. Berryman, B. Kozma, and D. Abbott, Phys. Lett. A 350, 324 (2006). 
A.-L. Barabasi and H. Stanley, Fractal Concepts in Surface Growth (Cambridge University Press, Cambridge, 1995). 
T. Halpin-Healy and Y.-C. Zhang, Phys. Rep. 254, 215 (1995). 
J. Krug, Adv. Phys. 46, 139 (1997). 

Z. Toroczkai, G. Korniss, S. D. Sarma, and R. K. P. Zia, Phys. Rev. E 62, 276 (2000). 

S. Edwards and D. Wilkinson, Proc. R. Soc. London Ser. A 381, 17 (1982). 

G. Foltin, K. Oerding, Z. Racz, R. Workman, and R. Zia, Phys. Rev. E 50, R639 (1994). 

T. Antal and Z. Racz, Phys. Rev. E 54, 2256 (1996). 

R. Albert, H. Jeong, and A.-L. Barabasi, Nature 406, 378 (2000). 

Z. Toroczkai and K. Bassler, Nature 428, 716 (2004). 

Z. Toroczkai, B. Kozma, K. Bassler, N. Hengartner, and G. Korniss, arXiv:cond-mat/0408262. 

A. -L. Barabasi and R. Albert, Science 286, 509 (1999). 

E. Bender and E. Canfield, J. Comb. Theory A 24, 296 (1978). 

M. Molloy and B. Reed, Random Structures & Algorithms 6, 161 (1995). 

M. Molloy and B. Reed, Combinatorics, Probability and Computing 7, 295 (1998). 

M. Boguna, R. Pastor-Satorras, and A. Vespignani, The European Physical Journal B 38, 205 (2004). 

M. Catanzaro, M. Boguna, and E. Pastor-Satorras, Phys. Rev. E 71, 027103 (2005). 

B. Kozma and G. Korniss, in Computer Simulation Studies in Condensed Matter Physics XVI, edited by D.P. Landau, 
S.P. Lewis, and H.-B. Schiittler, Springer Proceedings in Physics Vol. 95 (Springer- Verlag, Berlin, 2004). 

A. Bray and G. Rodgers, Phys. Rev. B 38, 11461 (1988). 



16 



[99] G. Rodgers, K. Austin, B. Kahng, and D. Kim, J. Phys. A 38, 9431 (2005). 
[100] D. Kim and B. Kahng, in preparation; also, presentation by D. Kim at the Workshop in Optimization in Complex 

Networks, Los Alamos, June, 2006. 
[101] M. A. de Menezes and A.-L. Barabasi, Phys. Rev. Lett. 92, 028701 (2004). 

[102] A.-L. Barabasi, M. A. de Menezes, S. Balensiefer, and J. Brockman, Eur. Phys. J. B 38, 169 (2004). 
[103] M. Crovella and A. Bestavros, IEEE/ ACM Trans, on Networking 5, 835 (1997). 

[104] M. Crovella, M. Taqqu, and A. Bestavros, in A Practical Guide To Heavy-Tails: Statistical Techniques and Applications, 

edited by R.J. Adler, R.E. Feldman, and M.S. Taqqu (Birkhauser, Boston, 1998), p. 3. 
[105] W. Leland, M. Taqqu, W. Willinger, and D. Wilson, IEEE/ACM Trans, on Networking 2, 1 (1994). 
[106] I. Csabai, J. Phys. A 27, L417 (1994). 

[107] V. Paxson and S. Floyd, IEEE/ ACM Trans, on Networking 3, 226 (1995). 

[108] A.-L. Barabasi, Nature 435, 207 (2005). 

[109] H. Guclu, G. Korniss, and Z. Toroczkai, unpublished. 



